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(54) Methods and apparatus for digital subtraction angiography 



(57) A locally-adaptive method for obtaining sub- 
pixel registration of masK and opacified digital X-ray im- 
ages includes the steps of match point generation (14), 
locally-adaptive image-to-image warp generation (16), 
and tog subtraction (16), lor generating a DSA image 
(23). Specifically in match point generation, a set of two- 
dimensional points In the mask image and their corre- 
sponding points in the opacified image are derived. After 
match point generation, locally-adaptive image-to-inv 
age warp generation is performed using the image4o- 
image match points: that is, a transformation function is 
generated that maps the matched points in the mask 
image to their corresponding points in the opacified im- 
age. The generated transformation is then applied to the 
mask image data and the logarithm of the pixel value in 
the transformed (i.e., warped) mask image is subtracted 
from the logarithm of the corresponding pixel value In 
the opacified image. 
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Description 



This iwemion relates generally to X-ray imaging 
and. more particularly, todigiial subtraction angiography 
for imaging vasculature. 

Digital subtraction angiography (DSA) is a known 
x-ray procedure for observing vasculature, m one 
known DSA imaging method, X-ray images of anatomy 
are taken before and after an X-ray opaque contrast 
agent is injected into the bbod vessel Th a X-ray image 
taken before injecting trie contrast agent is sometimes 
referred to as the mask image and ihe X-ray image tak- 
en after injecting the contrast agent is sometimes re- 
lerredtoasthe opacified image. Logarithmic subtraction 
of the mask image from the opacified image should re- 
move all but the image data associated with the opaci- 
fied blood veseete. 

in principal, therefore, only the opacified vascula- 
ture should be visible in a DSA image, However, m prac- 
tice, ii isnot unusualfcra DSA image lo contain artifacts 
and other image data in addition to the data associated 
wilh the opacified vasculature. For example, there typi- 
cally Is a time lag between the acquisition of pre-oontraei 
and post-contrast images. Small patient motions during 
this Interval cause misregistration between the two in> 
age* leading to motion artifacts in the final DSA image. 

in addition, while certain types of patient motions 
can be controlled and minimized, several other types of 
involuntary motions (e.g.. cardiac) are much harder to 
control without major intervention. Such involuntary mo- 
tion has restricted, or limited, the use of DSA imaging in 
several anatomical regions, For example, in cardiac pro- 
cedures, only the opacified images are used 

Further, it is sometimes, necessary to move the X- 
ray imager between pre-contrast and post-contrast ex- 
posures. The imager usually cannot be repositioned at 
the exact same spot as the position in which the first 
image, i.e., the mask mage, has been obtained Also 
mechanicaJ vfcrstfons occur in the structural compo- 
nents of the imager. As a result, the mask Image and 
the opacified image typically are taken under slightly dif- 
ferent settings, respectively. In general, the mask and 
opacified images should be regarded as images taken 
by two highly correlated, but different, cameras. 

Hysteresis also causes differences in the mask im- 
age and the opacffled image. Particularly, the mask and 
opacified images win be distorted differently due to 
changes in the electrical and magnetic environment. For 
example, during image acquisition, the mask mages 
are acquired h a forward sweep of the imager gantry 
and opacified images are acquired in a reverse sweep 
of the gantry. Such electrical and magnetic differences 
result in artifacts in the DSA image due to a hysteresis 
effect. 

in an attempt to address the problems associated 
with ihe different conditions under which the mask and 
opacified images are obtained, many angiography ma- 
chines allow users to translate the mask image to better 
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register the mask image with to the opacified imaqe A 
^^r^ howeve, can ^ for ^ ^ 

2 atoned with the image plane. Such rigid p7 
tent motion, however. Is rarefy the type of motion which 
results in image artifacts. 

Another known attempt to address such imaging 
P^tems b described in Gupta-Srinrvaa, Image Warp- 

SCA^^ ISub1ractbnAneio9 ^ h "- p <£ 

or aaai, spring Symposium on Applications of Compu- 
ter •\rtston in Medical Image Processing, Stanford Uni- 

Sr^itS. 21 " 23 1994 - "^algorithm described 
by Gup!* ■ wmtvas warps ^ mask ^ ^ osf g 

W projecwe ti^formatbn to regfetarthe mask image 
to the opacified image. The global transformation ap- 
pfled to the mask image, however, applies the same 
transformation to all the pixels in the image. As a result 
such algorithm does not correct for any misregistration' 
changes from one part of the Image to enother part of 
fte frnage. The causes of subtraction artifacts men- 
tioned above, e.g. ( patient motion, invoiunlary motion 
change in camera parameters, and hysteresis, general- 
ly result in misregistrations in the mask and opacified 
images which are different for different pixels. 

it would be desirable to generate DSA images more 
aocuraiety.-Such accurato Images should preferably 
have minimum artifacts due, e.g., to motion and hyster- 
esis, and should be corrected for any misregistration 
changes from one part of the image to another part of 
the image. 

Briefly, in accordance with a preferred embodiment 
of the invention, a bcaify-adaptive method for sub-pixel 
registration of mask and opacified digital X-ray images 
which enables accurate subtraction of the mask image 
from the opacified image, includes the steps of gener- 
™19 match points, generating a kxaJly adaptive image- 
to-warp image transform, and performing log subtrac- 
tion for generating a DSA image. 

More specifically, In match point generation, a set 
of two-dimensional points in the mask image and their 
^responding points in the opacified image are derived. 
After performing match point generation, locally-adap- 
tive image-fo-image warp generation is performed using 
the irnage-t^irnaga match points. That is, atransforrna- 
tion function is generated that maps the matched points 
in the mask image to their corresponding points in the 
opacified image. The generated transformation is then 
applied to the mask image data and the logarithm of the 
pixelvalue in the transformed (Le., warped) mask image 
is subtracted from the logarithm of the corresponding 
pixel value h the opacified Image. Such subtraction le 
performed for each pixel Upon completion of such sub- 
traction for the entire image, the resulting data repre- 
sents a DSA imago. 

The above desortoed method provides accurate 
DSA images having fewer than the usual munber of ar- 
tifacts end is adaptive to corrucf for any misregistration 
changes from one part of an image to another part of 
the image. 
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An embodiment of the invention will now be de~ 
serfoed, by way d example, with reference in the ac- 
companying drawings, in which: - 

Figure 1 1s a flow chart illustrating processing steps 
in accordance with one embodiment of the present 
invention. 

Figure 2 is a flow chart illustrating processing steps 
for performing the match point generation process- 
ing step identified in the flow chart in Figure 1. 

The flow chart of Figure 1 illustrates a D5A method 
or process 10 for imaging vasculature, in accordance 
with one embodiment of the invention. Method 10 is a 
locally-adaptive method tor sub-pixel registration of 
mask and opacified digital X-ray images which enables 
accurate subtraction of the mask image from the opac- 
ified image. Prior to execuUng method 10, mask image 
data and opacified image data for a region of interest 
are obtained. 

After processing has been initiated at step 12, 
match point generation 14 is performed. In match point 
generation 14, a set of two-dimensional points in the 
mask image, and their corresponding points in the opac- 
IBeWifiiafl^ Han- 
nah, "A Description of SflPs Baseline Stereo System*, 
Technical Report Tech. Note 365, SRI International Ar- 
tificial Intelligence Center, October, igas, or any other 
match-point computation method that results in a dense 
grid erf matches between 
ages, can be used as step 1 4. 

After performing match point generation 1 4. locally- 
adaptive image-to-image warp generation 16 Is per- 
formed. More specifically: using the image-to-tmage 
match points generated at step 1 4, a transformation thai 
maps the matched points In the mask image to their re- 
spective corresponding points in the opacified image is 
generated at step 1 6 and the generated transfonrnation 
is applied to the mask image data Such transformed 
mask image data Is sometimes referred to as warped 
data. 

Once the transformation has been applied to the 
mask image data, the logarithm of the pixel value in Ihe 
transformed (lc. t warped) mask image is subtracted 
from the logarithm of the corresponding pixel value in 
the opaeffied image at step 1 8. Such subtraction is per- 
formed for each pfeei. upon completion ot such subtrac- 
tion for the entire imago, Ihe resulting data at step 20 
represents a DSA image. 

More specifically, In one embodiment of process 10 
described above, match-point generation 14 is per- 
formed in accordance with ihe method described in 
Gupta-Srinivas, "Image Warping for Accurate Digital 
Subtraction Angiography', Proc. of AAA!, Spring Sym- 
posium on Applications of Computer Vision in Medical 
image Processing, Stanford University. March 21 -2a 
1994. 

Figure 2 is a flow chart illustrating a method or proc- 
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ess for performing match point generation 14 of Figure 
1. Specifically, and as a pre-processing step following 
initiation 52 of match poht generation, an image hierar- 
chy, or pyramid. Is generated at step 54 in order to ac- 
s celerate the compulation of match points. Such hierar- 
chy is generated by successively reducing both images 
in the stereo pair to half their size (and resolution) via 
subsampling using Gaussian convolution. 

The matching process then begins with the lowest 
iq resolution Image, La., at the bottom of the image pyra- 
mid, and works 145 to frnages with Ihe highest resolution . 
More particularly, and starting with the lowest resolution 
image, a set of interesting points is identified In the mask 
image at step 56. The interesting points, In the one em- 
is bodiment, correspond to the pixels with the highest res- 
olution. Points of high local intensity variation are con- 
sidered interesting because they are easy to match. 

Initially, only the interesting points in the mask im- 
age are matched with their corresponding points in the 
20 opacified image, al step 68. In order to match a point In 
the mask image to is corresponding point in the opaci- 
fied image, and in one embodiment, a small tBe of im- 
agery around the point in the mask image is correlated 
with all tiles in the opacified image. This process pre- 
ss ceecte hierarchically from the lowest- resolution to the 
highest resolution. The center of the tils in the opacified 
image that gives the maximum correlation is identified 
as the corresponding match poht. 

The image tiles in the mask and the opacified im- 
30 ages may be rotated or translated with respect to each 
other. The mismatch arising because of such rotation is 
corrected by a nwo-cfimensional perspective transforma- 
tion of the mask Image tile to the neighborhood of its 
correspondirrg tile in the opacified image based, on us- 
$s er-provkled rough match points. The method described 
in Gupta-Srtarvas, "Image Warping for Accurate Digital 
Subtraction Angiography", Proc of AAAI, Spring Sym- 
posium on Applications of Computer Vision It Medical 
image Processfrg, Stanford University, March 21 - 23, 
40 1994, may be used 

Once a set of match points has been computed, the 
image-to-image transform for registering the image tiles 
between the mask and the opacified images is generat- 
ed at step 60. The matching process is then repeated, 
45 as indicated at step 62, using this new transform which 
is more accurate than that obtained from user-provided 
match points. 

Aftei processing the highest issolution imago data, 
the end 64 of ihe match point generation process is 
so reached, completing the process. For a set of points on 
a square grid in the mask vnage, the corresponding 
match points are identified in the opacified Image. Due 
to patient motion, hysteresis, and other such effects, the 
grid in the opacified image is not square. 

Once a gnd of match points has been found, the 
displacement (fydy.) that should be added to each grid 
point in the mask image to find the coordinates of the 
corresponding point in the opacified image is ctetar- 
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mined. Specifically, dxand dy&re considered as sepa- 
rable functions of the mask irragg coortirtate (x, y). That 
is: 
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image data, comprising the steps of: 



dx 






dy 
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where fand g are two unknown functions whose values 
are Known only at the grid points. The value of f and g 
at any arbitrary point ,n the mask image is determined 
by Interpolation. Importantly, the two displacements 
along xand yare treated separately, and the interpola- 
tion technique used preserves the values at the grid 
points. Interpolation techniques such as general poly- 
nomial transformation, bl-cubfc or thin-plate splines, or 
other types of global splines, e.g., the global spline de- 
scribed In Wolberg, "Digital Image Vferping*. IEEE Com. 
puter Society Press, Los Alamitos, CA. 1980, can be 
usod for performing the interpolatten. 
-"^-Jocatttforea^^ 

transfwmedbythedisplac^Tierits given by interpolation 
tofind the location of its corresponding pixel in the opac- 
ified image. The intensity of each pixel in the mask im- 
age is then log^ubtractedfrom its corresponding pixel 
m the opacified image. 

The above described method provides accurate 
,rm ^ having fewer artifacts, and is adaptive to 
correct for any misregistration changes from one part of 
an image to another part of the image. The method, 
moreover, is not limited to the specific implementation 
described above. For example, other hierarchical 
matching techniques, such as those described by 
Guam, •Hierarchical Warp Stereo", h MA Fischterand 
o. Flrschein, editors, Readings In Computer Vision 
pgs. 80-86, Morgan Kaufmann Publishers, ine . 1987 
can be used in match point generation. While a corral* 
tron-bascd matching scheme is descrfced above, a fea- 
ture-based matching scheme could alternatively be 

The above described methods can ba implemented 
By various types of processors such as, for example a 
general purpose computer or an application specific in- 
tegrated circuit (ASIC) including a microcontroller. The 
particular type of processor selected depends, for ex- 
ample, on the manner in which the image data is pro- 
vided and other desired operating characteristics 
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Claims 



1. A method for generating a digital subtraction angi- 
ography image from mask image daia arid opacified 



generating match points between the mask im- 
age data and the opacified image data; 
generating a locally-adaptive image transform 
using the generated match points; 
applying the transform to the mask image data 
to generate warp image data; and 
subtracting the logarithm of a warp image data 
value from the logarithm of the corresponding 
opacified image data value. 

The method of Claim 1 wherein the steps of gener- 
ating match points comprises generating a set of 
twoKjirnensonal points in the mask image data, and 
identifying corresponding points In the opacified Im- 
age data. 

3. The method of Claim 1 wherein the steps of gener- 
is match points comprises: 

generating an image resolution data hierarchy 
selecting the lowest resolution image data, and 
for the selected image data: 

(a) identifying a set of interesting points; 

(b) matching the interesting points in the 
mask image data with corresponding 
points in the opacified image; 

(e) determining an image^o^mage trans- 
form for registering image tiles between the 
mask and the opacified images; and 

(i) ff the highest resolution image data 
has not been selected, selecting the 
next highest resolution image data and 
repeating steps (a) - (o); and 
(ll) if the highest resolution image data 
has been selected, ending the match 
point generation. 

L The method of Claim 3 wherein the image resolu- 
tion data hierarchy is generated by successively re- 
ducing both the mask Image and the opacified im- 
age in a stereo pair to about halt their original size 
with subsampiing using Gaussian convolution. 

■ The method of Claim 3 wherein each of the set of 
interesting points corresponds to a respective one 
of the pixels with the highest resolution. 

ihe Interesting points in the mask imago data with 
responding points in the opacified image com- 
prises correlatfrig a email tie of imagery around a 
point in the mask image with an of the tiles in the 
opacified image and identifying the center of the tile 
in the opacified image in order to determine the 
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maximum correlation as the corresponding match 
point. 

7. The method of Claim 1 wherein the step of gener- 
ating match points comprises identifying a grid of 
match points, and said method further comprises 
determining a displacement (dx t dy) that should be 
added to each grid point in the mask image to find 
coordinates of the corresponding point in the opac- 
ified image. 

8. The method of Claim 7 wherein dtxand are relat- 
ed by: 

1S 





- 


dx 









where fend pare two unknown functions whose val- 
* lies are known only at grid points; 25 

9. The method of Claim 8 further comprising the step 
of determining values of /and pat an arbitrary point 
in the mask image by interpolation 

50 

10. The method of Claim 9 wherein the location of each 
pixel in the mask image is transformed by the dis- 
placements given by inteipolation to find the corre- 
sponding pixel In the opacified image. 
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(54) Methods and apparatus for digital subtraction angiography 

(57) A locally-adaptive method for obtaining sub- 
pixel registration of mask and opacified digital X-ray im- 
ages includes the steps of match point generation (14), 
locallynadaptfve mage-to-image warp generation (16), 
and log subtraction (18). lor generating a DSA image 
(20), Specifically h match point generation, a set of two- 
cfenensjonal points in the mask image and their corre- 
sponding points in the opacffied image are derived. After 
match point generation, locafly^adaptive image-to- rm- 
age warp generation is performed using the image-to- 
image match points; that is, a transformation function is 
generated that maps the matched points in the mask 
image to their corresponding points in the opacified im- 
age. The generated transformation is then applied to the 
mask image data and the logarithm of the pixel value in 
the transformed (Le. ( warped) mask image is subtracted 
from the logarithm of the corresponding pixel value in 
the opacified image. 
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